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Abstract 


The goal of our work in qualitative reasoning is to develop methods for automatically building 

qU H f a i ;r nd sem, n quantltatlve models of dynamic systems, and to use them for monitoring 
and fault diagnosis. Our qualitative approach to modeling provides a guarantee of coverage while 
our semiquantitative methods support convergence toward a numerical model as observations 
are accumulated. In recent work, we and our collaborators have developed and applied methods 
or automatic creation of qualitative models; developed two methods for obtaining tractable 

ZTre lZ Tl Tk 5 r W T PreV1 ° USly intractable for qualitative simulation; and developed 
more powerful methods for learning semi-quantitative models from observations and deriving 
semi-quantitative predictions from them. With these advances, qualitative reasoning come! 
significantly closer to realizing its aims as a practical engineering method. 


1 Introduction 

The world is infinite, continuous, and continually changing over time. Human knowledge and 
human inference abilities are finite, apparently symbolic, and therefore incomplete. Nonetheless 
people normally reason quite effectively about the physical world. * 

Models of particular systems or mechanisms play an important role in this capability. In service 
o a task such as diagnosis or design, simulation predicts the behaviors that follow from a particular 
modeh In diagnosis or explanation, these predictions include testable consequences of a diagnostic 
hypothesis. In design, these predictions make explicit the consequences of a set of design choices 

A qualitative differential equation (QDE) model is a symbolic description expressing a state 
of incomplete knowledge of the continuous world, and is thus an abstraction of an infinite set of 
ordinary differential equations models. Qualitative simulation predicts the set of possible behaviors 
consistent with a QDE model and an initial state. Together, these methods support a meaningful 
and sound approach to “proof by simulation”. 

We have developed a substantial foundation of tools for model-based reasoning with incomplete 
nowledge. QSIM and its extensions for qualitative simulation; Q2, Q3 and their successors for 

3^mor°T1 ° n a qualitative framework; and the CC and QPC model compilers for 
building QSIM QDE models starting from different ontological assumptions. 
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The QSIM representation tor qualitative differential equations (QDEs) and guaht ative b 
wholly motivated by protocol analysis 1 ^i^lsm. 

csr 1 tr x*. ^ 

taining this guarantee while producing a tractable set f or app ^ ing lo carefully 

exist for applying a deeper analysis, changing .. .. f m a w |J e tang e of useful models, 

chosen additional assumptions, to obtain .tractable predicts ion, a ra * lhe coveI . 

Quantitative information can be used be expressed 

age guarantee while prodding ^w^mbolic element of the qualitative description [Kuipers & 
as bounds on landmarks an y imorove the resolution of the descrip- 

Berleant, 1988], by adaptively inserting 1992 1993], and by deriving en- 

lion and converge to a numerical function Berleaat k Krnpers 1^2 19^, y ^ 

velopes bounding the possible trajectories of the systan [Kay fe Kui^rn, 1992, ] 

are interpreted by unifying quantitative measurements tntrtmnty in the' QDE and 

taftW rtatetoelirtore'o, tte3ting°behavioral description converges to the true quantitative 
behavior, though computational cost, can still be high with current me od . 

We have developed two “elided version of Qualitative 

connection view of a mechanism, and W-M imptem ^ or comparlm< . nta l mo d- 

drhave\ h rnVl'pXlsew C 3 These model-building tools will support deeper investigation 
into selection of views and modeling gumptions behaviors that are particularly 

[Perrow, 1985], Each model begins as a ^TlTthe model/data unification 

knowledge and with the stream of incoming ^'Xmlsto contradiction, the predictions of the 

We also constructed a QSIM mo P . .1 cummer of 1992 our group hosted 

Xwtag sections present abstracts of publications summarizing many of our recent results. 
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2 Automated Model Building 
2.1 QPC 


Adam Farquhar has built the QPC model compiler into a substantial tool 
theories and qualitative models for complex physical systems. Farquhar’s 
formalizes and proves the soundness of the QPC model-building algorithm an 
engineering-quality guarantees. 


for building domain 
doctoral dissertation 
essential step toward 


Automated Modeling of Physical Systems 
in the Presence of Incomplete Knowledge 
Adam Farquhar 

Department of Computer Sciences 
University of Texas at Austin 

This dissertation presents an approach to automated reasoning about physical systems in 
the presence of incomplete knowledge which supports formal analysis, proof of guarantees has 
been fully implemented, and applied to substantial domain modeling problems. Predicting 
and reasoning about the behavior of physical systems is a difficult and important task that is 

essen la o everyday commonsense reasoning and to complex engineering tasks such as design 
monitoring, control, or diagnosis. ® 

A capability for automated modeling and simulation requires 

• expressiveness to represent incomplete knowledge, 

• algorithms to draw useful inferences about non-trivial systems, and 

• precise semantics to support meaningful guarantees of correctness. 

In order to clarify the structure of the knowledge required for reasoning about the behavior 
of Physical systems, we distinguish between the model building task which builds a model to 
describe the system, and the simulation task which uses the model to generate a description of 
the possible behaviors of the system. p 1 OI 

t h'T K rta M° n de f cnbes an lm Plemented approach to reasoning about physical 

ysjems that builds on the expressiveness of Qualitative Process Theory [Forbus, 1984] and the 
mathematical rigor of the QSIM qualitative simulation algorithm [Kuipers, 1986]. 

H i fFererw semantics of QPC’S modeling language are grounded in the mathematics of ordinary 

! oP?SlTf 0nS ^ r u 0nS ‘ THiS formalizatio " cables the statement and proof 
of QPC s correctness. If the domain theory is adequate and the initial description of the system 

predicts ^ ^ behav,or of the s y stem must be in th e set of possible behaviors QPC 

fro^rh^ 35 | b p n SUCCeSSfuIly a P? Iied to P roblems in B o^ny and complex examples drawn 
the modewf Eng ' neenng ’ 85 wel1 M numerous smaller problems. Experience has shown that 
^e modeling language is expressive enough to describe complex domains and that the inference 
mechanism is powerful enough to predict the behavior of substantial systems. 

2.2 QPC Applied to Chemical Engineering 

Catmo [1993] constructed a large QPC domain theory within chemical engineering for the purpose 
of doing hazard and operability (HAZOP) studies of moderate-sized chemical process plants The 

28fTvajiabl^ r ^ TZT °' 5 ,° + model ' ra * mente ’ and has bee ” to construct models as large as 
280 variables and 340 constraints, making it one of the largest qualitative models ever built. The 
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abstract 

below. 


of her doctoral dissertation, written under the supervision of Prof. Lyle Ungar, is quoted 

Automated Modeling of Chemical Plants 
with Application to Hazard and Operability Studies 

Catherine A. Catino, Ph.D. 

Department of Chemical Engineering 
University of Pennsylvania 


—is 

^r*a" Xysical description of the equipment .nd component, preomt, the,, Conner- 
tn create a new model when a new phase exists. , A , ___ 


3 Tractable Qualitative Simulation 

3.1 Qualitative Phase Portraits 

The phase portrait is an important tod by 

t:r d r ^ Ph a« p^,. „ f 

non-trivial systems, inheriting the QSIM guarantees of complete coverage. 
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A qualitative method to construct phase portraits 
Wood Wai Lee and Benjamin J. Kuipers 
AAAI-93 

We have developed and implemented a method based on qualitative simulation to con- 
struct phase portraits for a significant class of systems of two coupled first order au- 
tonomous differential equations, even in the presence of incomplete, qualitative knowl- 
edge. 

Differential equation models are important for reasoning about physical systems. The 
field of nonlinear dynamics has introduced the phase portrait representation as a pow- 
erful tool for the global analysis of nonlinear differential equations. 

QPORTRAIT uses qualitative simulation to generate the set of all possible qualitative 
behaviors of a system. Constraints on two-dimensional phase portraits from nonlinear 
dynamics make it possible to identify and classify the asymptotic limits of trajectories 
and constrain their possible combinations. By exhaustively forming all combinations 
of features, and filtering out inconsistent combinations, Qportrait is guaranteed to 
generate all possible qualitative phase portraits. 

We have applied Qportrait to obtain tractable results for a number of nontrivial 
dynamical systems. 

Guaranteed coverage of all possible behaviors of incompletely known systems comple- 
ments the more detailed but approximation-based results of recently- developed methods 
for intelligently-guided numerical simulation [Nishidaet al; Sacks; Yip; Zhao]. Together, 
these methods contribute to automated understanding of dynamical systems. 

3.2 Behavior Abstraction 

Daniel Clancy has developed a method for creating a lattice of abstractions of the tree of pos- 
sible qualitative behaviors, providing a space of alternate descriptions with different degrees of 
tractability and discriminating power. 

Behavior Abstraction for Tractable Simulation 
Daniel J. Clancy and Benjamin Kuipers 
QR-93 

Most qualitative simulation techniques perform simulation at a singlelevel of detail high- 
lighting a fixed set of distinctions. This can lead to intractable branching within the 
behavioral description. The complexity of the simulation can be reduced by eliminating 
uninteresting distinctions. Behavior abstraction provides a hierarchy of behavioral de- 
scriptions allowing the modeler to select the appropriate level of description highlighting 
the relevant distinctions. Two abstraction techniques are presented. Behavior aggre- 
gation eliminates occurrence branching by providing a hybrid between a behavior tree 
representation and a history based description. Chatter box abstraction uses attainable 
envisionment to eliminate intractable branching due to chatter within a behavior tree 
simulation. 
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4 Semi- Quantitative Reasoning 

Herbert Kay, collaborating with Kuipers and Ungar, has developed two major pieces of the puzzle 
of semiquantitative simulation. First, he has created, implemented, and proved the soundness 
of the dynamic envelope method for predicting improved bounds on behavior trajectories given 
bounds on landmark values and envelopes around monotonic functions. Second, he and Ungar 
have developed a new method for learning envelopes around monotonic functions from a stream ot 

observations. 

4.1 Predicting Dynamic Bounds on Behaviors 

Numerical Behavior Envelopes for Qualitative Models 
Herbert Kay and Benjamin Kuipers 
AAAI-93 

Semiquantitative models combine both qualitative and quantitative knowledge within a 
single semiquantitative qualitative differential equation (SQDE) representation. With 
current simulation methods, the quantitative knowledge is not exploited as fully as 
possible. This paper describes dynamic envelopes - a method to exploit quantitative 
knowledge more fully by deriving and numerically simulating an extremal system whose 
solution is guaranteed to bound all solutions of the SQDE. It is shown that such systems 
can be determined automatically given the SQDE and an initial condition. As model 
precision increases, the dynamic envelope bounds become more precise than those de- 
rived by other semiquantitative inference methods. We demonstrate the utility of our 
method by showing how it improves the dynamic monitoring and diagnosis of ;i ' ..cuum 
pumpdown system. 

4.2 Learning Static Bounds on Functions 

Deriving Monotonic Function Envelopes from Observations 
Herbert Kay and Lyle H. Ungar 
QR-93 

Much work in qualitative physics involves constructing models of physical systems us- 
ing functional descriptions such as “flow monotonically increases with pressure.” Semi- 
quantitative methods improve model precision by adding numerical envelopes to these 
monotonic functions. Ad hoc methods are normally used to determine these envelopes. 
This paper describes a systematic method for computing a bounding envelope of a mul- 
tivariate monotonic function given a stream, of data. The derived envelope is computed 
by determining a simultaneous confidence band for a special neural network which is 
guaranteed to produce only monotonic functions. By composing these envelopes, more 
complex systems can be simulated using semiquantitative methods. 
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